Coarse-grained probabilistic automata mimicking chaotic systems 
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Discretization of phase-space usually nullifies chaos in dynamical systems. We show that if ran- 
domness is associated with discretization dynamical chaos may survive, and be indistinguishable 
from that of the original chaotic system, when an entropic, coarse-grained analysis is performed. 
Relevance of this phenomenon to the problem of quantum chaos is discussed. 
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Chaos is a common characteristic of motion in contin- 
uous spaces. It is signaled by many indicators. Among 
these, positivity of the Kolmogorov-Sinai (K-S) entropy 
is perhaps the most significant, both in theory and ap- 
phcations P, 0]. On the other hand, trajectories in dis- 
crete spaces are always asymptotically periodic — hence, 
of null K-S entropy. They may arise in the discretization 
of continuous systems, as in the numerical simulation of 
differential equations, but arguably their role is most sig- 
nificant in the correspondence of classical and quantum 
dynamics. 

Consider for instance the paradigmatic example of the 
quantum Arnol'd cat. Its dynamics are algorithmically 
equivalent to classical motion on a regular lattice, whose 
spacing is inversely proportional to the Planck constant 
0,0]. When the spacing diminishes, the lattice becomes 
denser in continuous, classical phase-space. Yet, it has 
long been recognized that chaos cannot be naively re- 
vived in such a limit procedure |^ |^ . A way out of 
this impasse is obtained by randomly perturbing the dy- 
namics 0: is this addition enough to bring back the full 
algorithmic content, that is the distinctive signature of 
chaos ? We attempt here an answer to this question 
in the most general and simple terms. 

Deterministic-probabilistic systems (such as those oc- 
curring in cellular automata 9\) have long been investi- 
gated, with respect to their invariant measures llCl . and 
also to the entropic content of their motion We 
now extend this study to the regime where continuous, 
discrete, and random effects are simultaneously present, 
and intermix in non-trivial ways. 

Let us therefore consider the deterministic map 



Xt+l = f{xt), 



(1) 



where t is discrete time, x belongs to [0, 1]^ and D is the 
dimension of the space. We embed in [0, 1]-^ a uniform 



rectangular lattice, of spacing rj, and we label its states 
by integer vectors n in [1, [^J]^ (L'J is the integer part) 
[l^ . We then restrict the map / to act on this lattice, 
and we add randomness: 



nt+i = [-/('? "-t)J + 



(2) 



We stipulate that the rmcorrelated, random "jumps" at, 
extend to lattice neighbors with total probability p, so 
that at — with probability 1—p. Note that when p = 
the system is purely deterministic. For definiteness, we 
shall study the generalized tent map in one dimension: 



Xt+l 



axt for Q < X < - 

a{l - xt) / {a ~ I) for \<x<l 



(3) 



with a — i, the two-dimensional Arnol'd cat map 0: 



Xt+l 

yt+i ■ 



■ Xt 

Xt - 



-yt mod 1, 
2yt mod 1 



(4) 



and their probabilistic lattice automata, eq. 

We are now ready to briefly introduce our analytical 
tools. Let {£^1, i?2, . ■ ■} be a finite partition of phase 
space consisting of identical hyper-cubic cells of side e. 
Let We = w\,w1, . . . , be a finite symbolic trajectory. 



of length 



We 



i if and only if Xi e Ej 



Let also p(we) be the frequency of We, defined by the 
physical ergodic measure. The n-block entropies Hn{e), 
n = 1,2, . . ., are defined by the sums 



(5) 



Wf. : \w^\—n 



The partition entropy h{e) is the limit of _ff„(e)/rt, or, 
with faster convergence, of the information rate hn (e) — 
ff„(e) — i?„_i(e), as n — !■ oo 0,E3- The K-S entropy Hk 
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is the supremum of the partition-entropies, with respect 
to all countable partitions; hence, h{e) < Hk, and Hk can 
be obtained letting e go to zero. However, the function 
h{e) for finite e is interesting in its own right 0|. This 
is because it gauges the rate of information production, 
for observations of finite accuracy, as a function of the 
resolution desired. In line with our approach in we also 
ascribe importance to the full behavior of i?„(e) versus 
n, and not only to the limit h(e). 

It is well-known that the systems (jSJ, Q have posi- 
tive K-S entropy. In contrast, the dynamics of the purely 
discrete systems {i.e. eq. ((2Jl with p = 0) are periodic, 
hence of null entropy. Yet, at scales larger than the lattice 
spacing, e > em '■= they approximate the continuous 
dynamics for a finite time, roughly of the order of the log- 
arithm of the period of the trajectory HI El El El EJ. 
As a consequence, the entropies 7?„(e) are also close to 
those of the continuous system, for n < n. The upper 
boundary n can be estimated requiring that at n = n the 
number of different e-histories of length n of the contin- 
uous system, Me{n) ~ exp(ft(e) n), be of the same order 
of the number of discrete states, M ^ (1/77)^. Here D is 
the dimension of the attractor or, in the absence of this 
latter, the dimension of the space. This leads to: 



logM 



I? log 77 



(6) 



Dependence of n on the average period of trajectories, 
T, follows equally well. Since T - Af^^/^, where D2 is 
the correlation dimension of the ergodic measure |20|, 



2i:>logT 

n 



D2 h{e) 



(7) 



In the deterministic discrete systems (eq. Q with p — 
0) , n may be large enough to observe the entropic growth 
of the continuous map, and sometimes to compute the 
entropy h{e) of the latter to a fair accuracy. However, 
when n exceeds n, the rt- words entropies, quickly 
saturate at a constant value, of the order of logT, or 
log(l/?7), or logM, which reveals the periodic regime of 
the dynamics. It is clear that while the time n is model- 
dependent, its logarithmic scaling with the parameters is 
universal: the discrete, "pseudo" chaos seems to be very 
short-lived 0, H |1| ■ It is at this point that the random 
jumps at completely change the scenario. 

First of all, the null-entropy, periodic system is turned 
into an aperiodic stochastic process of maximal entropy 
hp. If at extends to k neighbors with equal probability 
p/k, then hp = — pln(p/fc) — (1 — p)ln(l —p). Since hp 
totally originates from the random jumps at the lattice 
scale Cm, it can be fully detected only at this scale: hp ~ 
h{em) > h{e), for e > £„. 

It is clear that hp has no relation with the K-S entropy 
hK. Then, two cases must be considered. In view of 
the above, when hp < h^, addition of randomness, and 



FIG. 1: 71-word entropies H„(e, M) vs. n for the discretized 
tent map with e = 1/18, and M = 252 1008 (x), 

and 4032. H„{e,A4) are compared to the lines with slope 
/i(l/18) ~ 0.20 and Hk ^ 0.636. 



observational coarse-graining, cannot achieve the full en- 
tropy content of the continuous system. This no-go rule 
does not apply in the opposite case. We find that when 
hp 3> hK and Cm, the partition- entropies of the con- 
tinuous system and of the discrete ones tend to coincide. 
Notice that the condition e ^ requires that the num- 
ber of discrete states per cell, Me^, be large. 

To prove these claims, let us first consider the tent 
map, eqs. (|2I3I) . with p = 0.05, and nearest-neighbor 



random jumps. In this case hp ~ 0.233 is much smaller 
than hx — 0.636. Fig. ^ plots Hn{e,M) versus n, for 
different values of M, and e — 1/18. This partition is 
generating, so that the partition entropy of the continu- 
ous map, /icont(l/18), is equal to hx. We observe that 
for n < n, /i„(e) is approximately equal to hK, the en- 
tropy of the continuous system. Later on, for n > n, the 
curve H„ bends and — rather than tending to a constant, 
as it would if randomness were not present — redirects its 
growth to a different linear regime: Hn ~ h{e,M){n — 
n) -f A logM, with A a suitable constant. Numerically, 
we also find that h(e, M) ~ 0.20 ~ hp, independently 
of M, even if e = 1/18 is much larger than e„i. This is 
noteworthy: were the evolution driven only by the prob- 
abilistic diffusion, ut+i = nt -\- at, the e-cntropy would 
have been ten times smaller, /idiff(l/18, 252) ~ 0.02. The 
effect of randomness is strongly enhanced by the deter- 
ministic evolution [2l| . 

By raising the value of the jump probability p |23 | the 
entropy hp increases, and it may exceed the K-S entropy 
hK, or ft.cont(e) for a given e. Fig. |21plots h{e,M) versus 
hp, for different values of M. At fixed, low hp, the M 
dependence is rather mild, as was observed in Fig.^ and 
h{e, M) is smaller than /icont(e)- Raising hp at fixed M to 
well exceed this value, and then increasing M , we obtain 
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FIG. 2: Partition-entropies of the discretized tent map 
h{e,M) vs. hp, with fc = 4, e = 1/7 and M = 63 (+), 
M = 168 (x) and M = 4032. The dotted line is drawn at 
ftcont(l/7), the partition-entropy of the continuous system for 
e = 1/7. 
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FIG. 4: Entropies h{€, M) vs. Me in the perturbed Arnol'd 
cat map. Here, M = 16^ (squares), 32^ (circles), 64^ (dia- 
monds), 128^ (filled squares), 256^ (filled circles), and 512^ 
(filled diamonds); e = 1/4, 1/16, 1/64. The horizontal line 
is drawn at Hk — 0.962. In the inset, hn{e,M) vs. n for 
e = 1/64 and M = 16^ ... , 256^ (coded as before). At the 
largest value of M, M = 256^, the purely discrete system 
(hearts) shows rapid convergence to zero, in accordance with 
eqs. 16171 . The purely diffusive system (clubs) on its part is 
consistently close to /idiff(l/64, 256^) ~ .085. 



FIG. 3: e-entropies h{e, M) versus z = A'le, for the discretized 
tent map, with e = 1/7 and e = 1/10 (x). Horizontal lines 
are drawn at /icont(l/7) fa .54, and /icont(l/10) fa 0.58. 



convergence of h{e,M) to /icont(e)- 

This convergence is further illustrated in Fig. O by fix- 
ing hp — 1.5, by choosing e — 1/7 and e = 1/10, and by 
plotting h{e, M) versus z = Me, the number of lattice 
points enclosed in a cell of the partition. The different 
curves tend to coincide for small z, where the entropies 
overshoot: when coarse graining is too fine (too few states 
in a cell) the direct action of randomness is dominating. 
This effect fades in the opposite direction: randomness 
becomes a germ that gets scale- amplified by the dynam- 
ics, and h{e,z/e) tends to /icont(e), the partition-entropy 
of the continuous system. 

This behavior appears to be generic, as indicated by 
the results for the two-dimensional Arnol'd cat map, sub- 



ject to a random perturbation with k = A and hp = 1.5, 
plotted in Fig. |3| Since e = 1/4,1/16,1/64, all pro- 
vide generating partitions, the corresponding values of 
^cont(e) are equal to hx — 0.962. As a consequence 
the data fall on a single line, starting from the entropy 
of the random perturbation, hp = 1.5, and converging 
to the K-S entropy hx — 0.962. The convergence of 
hn{e, M) to the asymptotic values is shown in the inset 
of Fig. 01 together with the partition entropies obtained 
for the purely discrete system {p = 0), and for the purely 
stochastic motion. This comparison proves that /i(e, z/e) 
are truly asymptotic values, and provides further evi- 
dence in support of our explanation of the phenomenon, 
with which we now conclude. 

Imposing a finite lattice to the otherwise continuum 
set of states of a dynamical system, inevitably bounds 
the algorithmic complexity of its trajectories, and the 
value of its partition entropies, to the logarithm of the 
number of states. If the lattice is perceived with some 
fuzziness — or if random errors are allowed, following the 
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approach of this paper — one expects that on large scales 
continuum properties, and chaos might re-emerge, and 
be indistinguishable from that of the original system . 
We have determined the conditions for this to happen. 
Firstly, observational coarse-graining must be invoked. 
Secondly, the action of the external randomness must be 
confined to the "microscopic" , unresolved scales. The in- 
stability of deterministic dynamics amplifies these micro- 
scopic, random errors, and carries them over to the large, 
observation scales. Finally, by a sort of conservation law, 
the flow of information supplied by the microscopic "zit- 
terbewegung" must not be less than hx, the maximum 
entropy production rate of the continuous system. 

For a long time, research in quantum chaos has looked 
for quantum characteristics related to classical chaotic 
motion. The fact that none of these could be properly 
called chaos led to the concept of pseudo-chaos, and 
cast doubts on the very existence of chaos in nature. 
The results presented in this paper suggest that one 
might try to reverse this approach and consider classical 
dynamics as an effective theory that, via truly chaotic 
deterministic dynamical systems, models a randomly 
perturbed quantum motion under observational coarse- 
graining. 
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